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INTRODUCTION 



The administration of Chapter I programs in the State of Idaho is the respcnsibihty of the Office of Compen- 
satory Education, Division of State-Federal Programs. The Idaho Department of Education is required to 
demonstrate the effectiveness of these programs through the preparation of a re^ 'ort evaluating the results of pro- 
grams supported during the previous year. 

The desire for evaluative information has increased as the public has increased its demand for accountability 
from the educational process. The evaluation system first created for Chapter I when it was Title I ESEA has had 
a great impact on the development and use of evaluation techniques in the field of education. 

Models for evaluation emphasize the importance of stated goals and objectives so that progress can be measured. 
The goal of Chapter I programs is to equalize educational opportunity for groups and individuals who are 
educationally disadvantaged because of socioeconomic, cultural, physical, or mental handicapping conditions. 



ERLC 



4 



Evaluation Report 
Chapter I ECIA 
Project Year 1985-86 



The purpose of Chapter I is to provide supplemer ^al 
instruction to educationally deprived students in the 
basic skill areas of reading, mathematics and 
language arts. The goal is to raise the student's level 
of achievement and therefore eliminate the need for 
continuing compensatory education. 

The state allocation of federal funds for the project 
year 1985-86 was $9,256,844. This amount was 
distributed to 111 districts who were then responsible 
to operate remedial instructional programs under the 
established policies and guidelines. Services were of- 
fered in 353 of the 375 eligible buildings within these 
districts. A cost analysis of project expenditures in- 
dicates that 85% of program monies supported direct 
instructional services in the form of instructional 
salaries, materials, supplies, and equipment. 



Chapter I Cost Analysis 




> Equlpr ent 
3.8% 1370.00300 

■ Staff Development 
1.9% $162.50000 

' Purchased Services 
13% $133,741 00 

■ Travel 

1 1% $115,10300 
Parent Actlvltlea ar^d 
Sumrrar M & O 
5% $44,38600 



Instructional Salaries 
76% $7,343,453 00 
■ Benefits 
6% $579,604 00 

- Supplies and Materials 
4 6% $467.163 00 

- Administrative Salaries 
4 6% $445,798 00 



STUDENTS SERVED 

Students arr screened to c'jtermine those most in 
need of Chapter I services. Baseline data such as tes^ 
results, classroom achievement, functional level and 
age-grade comparisons are collected on each student 
through a cooperative effort involving classroom 
teachers. Chapter I staff, special services st<.ff and ad- 
ministrators. 

The average pretest scores for students with pre- and 
posttest scores served in the 1985-86 project year are 
presented in the following table as both normal curve 
equivalents (NCE) and precentiles. NCE s are used in 
the collection of test data by the State due to the 
equal interval scale which allows for aggregation 
across projects and grade levels. 

Percentiles are included as they are more widely 
understood. Statewide, the average percentile rank 
of Chapter I students was 21. Therefore, of tite 
students tested nationally, 79% scored higher than 
the students served in Idaho by Chapter I. 



Pretest 


Scores 














Natio <al 


Number 


Subject 


Test Cycle 


NCE 


Percentile 


of Cases 


Reading 


Fall Spring 


34 1 


23 


5 735 


Reading 


Spring Spring 


34 4 


23 


1 829 


Math 


Fait Spring 


31 5 


19 


3 400 


Math 


Sprmg-Spnng 


33 5 


22 


1 179 


Language Arts 


Fall Spring 


32 5 


20 


616 


Language Arts 


Spring-Spring 


33 8 


22 


155 



The total unduplicated number of participants in 
Chapter I programs in public and non-public schools 
was 16,829. Note that the majority of services are at 
the elementary level and more 2nd grade students 
participated than from any other grade. Research sup- 
ports this early intervention due to the relative ease 
of remediation and resulting probability of success. 
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Participants by Grade Level 



Public Schools 



Non-Public Schools 



12 

11 

10 

9 

8 

7 
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5 

4 

3 

2 
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3 134 
3271 
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12] 



25 



1 
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Total 82 
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Participants by 
Subject Area 




- READING 59 7% 
• MATH 351% 



■ LANG ARTS 5 2% 



Participants by 
School Program 




The total duplicated count of services to students in 
public and non-public schools was 19,882. A 
breakdown of services to students over the last five 
yea. s shows that there has been an increase in math 
instruction and a corresponding decrease in reading 
instruction. It ?,)j>ears that the emphasis placed on 
the importance of math skills in relation to 
technological advances nationally has had an impact 
on Chapter I servic* 

Services by Subject Area 




READING 



MATH LANG ARTS OTHER 



Student characteristics of those served are illustrated 
in the following tables: 



Services by 
Gender 




42% GrRLS 58% BOYS 




Services by 
Ethnicity 



11% HISPANIC 
3.4% INDIAN 
1.1% ASIAN 
S% BLACK 
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Services by 
LAU Category 




-91% ENGLISH ONLY 
-3 5% ENGLISH DOMINANT 



.1.1% L1 DOMINANT 
2% L1 ONLY 



PROGRAM CHARACTERiSTICS 

Chapter I instruction is designed to meet the specific 
needs of Chapter I students. Individual diagnosis and 
prescription allows teachers to design curriculum to 
insure student success. The instructional programs 
averaged 34 weeks in duration with 75% of the 
students attending between 32 and 36 weeks. 

By far the majority of students, 77% of those served, 
received instruction outside of the rer?ular classroom 
in pull-out programs held in special Chapter 1 
resource rooms. The number of students served 
within the regular classroom by Chapter I teachers 
and aides is increasing and now represents 17% of 
the total. Students served in more than one setting or 
with the addition of computer assisted instruction in 
a lab design is 6% of all Chapter I students. In all 
situations the instruction was by staff trained to give 
remedial instruction in reading, mathematics, and 
language arts. 

In many instances the instruction was provided on a 
one-to-one basis. Small groups with a 
student to teacher ratio up to 5:1 was the instructional 
mode for 78% of the students in reading and 
language arts and for 68% of the students in math. 

The number of hours per week of instruction varies 
according to grade level and subject area. Generally, 
elementary programs offer 2.5 hours of instruction 
per week. This is the treatment period for 45% of the 
students served in reading, 34% of those in language 
arts and 15% of those in math programs. The secon- 
dary programs are longer, averaging four hours of in- 
struction per week. 
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PROGRAM EFFECTIVENESS 

The achievement scores reported for participants in 
each program component reflect a significant gam. 
This is measured by a comparison to students who do 
not receive Chapter I instruction. For example, a 
group of non-Chapter I students who scored at the 
40th NCE at the beginning of the year is expected to 
maintain the same relative standing throughout the 
year. 

Any change in the NCE ranking of a group of 
Chapter I students from the pretest to the posttest is 
attributed to Chapter I instruction. Thus, if a 
Chapter I student scored at the 34th NCE on the 
pretest and at the 41st NCE on the postlest, the gain 
of 7 NCE s is a measure of the impact of Chapter I in- 
struction. 

The following graph shows gains for the past five 
years by subject area. Note that the gains made m 
each area have steadily increased and that due to the 
size of the popu^tion the gain is statistically signifi- 
cant. 

Average NCE Gain by 
Subject Aiea 




READING 



MATH 



LANG ARTS 
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PROGRAM STAFF 

The staffing in the district programs to provide ser- 
vices to students was as follows: 

Regular Term Staff 



Administrators 


74 


Teachers 


266 


Teacher Aides 


272 


Tutors 


182 


Curriculum Specialists 


9 


Support 


5 


Clerical 


31 



The following graph shows the instructional staff 
trend over the past five years. As illustrated, the 
number of certified teachers employed in the pro- 
gram was increasing and the number of aides 
decreasing in the first four years charted. Both counts 
dropped in FY 1986 due to the reduction in funding of 
the Chapter I program nationally. 

Instructional Staff Trend 




^ C AIDES / C AIDES / C AIDES / I AIDES / C AIDES J 


TEACHEHSI 


. TEACHERS t 


TEACHERS 


TEACHERS ( 


TEACHERS M 


1982 


1983 


1984 


1985 


1986 



Training was provided for a number of Chapter I 
staff and parents. There is a continued effort to in- 
volve Chapter I parents in the planning, implementa- 
tion and results of the instructional program received 
by their children. As noted, more parents were in- 
volved in training sessions statewide than any pro- 
gram staff group. 

Training Participants 

Administrators 74 
Teachers 277 
Teacher Aides 216 
Tutors 156 
Curriculum Specialists 4 
Parents 363 



CHAPTER I SUMMER PROGRAM 



Several districts in Idaho oj>erated summer tutoring 
programs which offered instruction in the basic skill 
areas of reading and math. Of the seventeen (17) 
districts reporting, the majority instructed students 
from 1 to 4 hours per day. The students were taught 
either one-on-one by the teacher or in small 
homogeneous groups. A few of the programs includ- 
ed a component of computer assisted instruction for 
participating students. The staffing in these seventeen 
district programs was as follows: 

Summer Term Staff 



Administrators 12 

Teachers 63 

Teacher Aides 24 

Tutors 5 

Curriculum Specialists 1 

Clerical 3 



The projects served 1,059 students who were in grades 
Kindergarten to 8th grade in the school year just 
completed. As in the regular term, the group with the 
most participants was 2nd grade. 



Summer School Participants 




K1234567B 
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Evaluation Report 
Chapter I Migrant Education 
Project Year 1985-86^^= 



The purpose of Chapter I Migrant Education is to 
provide supplemental instruction and support ser- 
vices to meet the special educational needs of 
children of migrant farmworkers. Supplemental in- 
struction is provided in the basic skill areas of 
language, reading, and mathematics. Support ser- 
vices may be provided in the areas of attendance, 
health, dental, nutrition, and transportation. These 
services occur when intervention is necessary to the 
successful completion of educational goals. The ob- 
jective is to raise the student's ability to function in 
English and the level of achievement in the 
classroom, thereby eliminating the need for continu- 
ing compensatory education. 

The state allocation of federal funds for the project 
year 1985-86 was $3,660,208.00. This amount was 
distributed to thirty-^ix (36) school districts who were then 
responsible to operate remedial instructional and 
support programs under the established policies and 
guidelines. Services were offered to all eligible 
migrant students within these districts and educa- 
tional programs were operated in 158 buildings. 

A cost analysis of project expenditures indicates 69% 
of program monies supported direct instructional 
programs in the form of instructional salaries, 
materials, supplies, equipment, and pupil transporta- 
tion. The Migrant Education Program is required by 
law to identify and certify the eligibility of each stu- 
dent served. This effort is represented in the chart as 
support salaries plus a portion of the benefits and 
travel budgets. This totals more than 15% of project 
expenditures. 
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Chapter I Migrant Cost 
Analysis 




rMAO 



STUDENTS SERVED 

Students are initially served through the enrollment 
process of entering individual data into the Migrant 
Student Record Transfer System. This data is then 
transferred across the nation as students move from 
one school district to another. Regular term enroll- 
ment figures shown below were obtained directly 
from MSRTS through the analysis of a data tape. 
The total unduplicated number of students enrolled 
in the regular term was 7,694. 

Enrollment by Grade Level 



Total 7.694 




10 11 12 UG 



Supplemental instruction is provided to eligible 
students on the basis of need as determined by assess- 
ment, classroom achievement, functional level and 
age-grade compaiisons. Classroom teachers refer 
students in nerd of services and work closely with the 



migrant staff 'n determining instructional objectives 
to insure the coordination of curriculum. 

The average pretest scores for students with pre- and 
posttcst scores served in the 1985-86 project year are 
presented in the following table as both normal curve 
equivalents (NCE) and j>ercentiles. NCE s are used in 
the collection of test data by the State due to the 
equal interval scale which allows for aggregation 
across projects and grade levels. Percentiles are in- 
cluded as they are more widely understood. 

Statewide the number of students receiving instruc- 
tion in reading, math, and language arts with pre-and 
posttest scores was approximately 30% of the total. 
The average pretest NCEs in the following table, 
therefore, are repicsentative of the more stable 
settled-out migrant <;tudents. Currently migrant 
students v;ho have the most difficulty in achieving 
succ^s in the classroom are not included as they are 
not available for both pre- and posttesting on the 
norm dates. 



Pretest Scores 




Natlonel 


Numb«r 


SubjMt 


Test Cycle 


NCE 


Percentile 


of Catea 


Reading 


Fall-Spring 


30 6 


18 


235 


Reading 


Spring-Spring 


39 7 


31 


285 


Meth 


Fall-Spring 


31 8 


19 


116 


Math 


Spring-Spring 


42 2 


36 


179 


Language A:l8 


Fail-Spnng 


31 7 


19 


37 


Language Arts 


Spring-Spring 


40 1 


32 


100 



The total unduplicated number of participants in the 
regular term instructional programs was 2,567. The 
majority of services are at the elementary level and 
more 1st grade students participate than from any 
other grade. Early intervention is especially impor- 
tant with the special population in the migrant pro- 
gram. Deficiencies are easier to remediate at this level 
and this results in a higher probability of success and 
more children going back into the regular inslruc- 
tion^i program. 

Participants by Grade Level 



43f 
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Participants by Subject Area 



ESL 21% 

Reading 36% 

Language Arts 13% 

Math 22% 

Vocational/Careers 1 % 

Other 7% 

Participants by Schooi Program 

Elementary (1-8) 80% 

Secondary (9-12) 8% 

Kindergarten 11% 

Ungraded 1% 



The total duplicated count of instructional services to 
«tudents in the regular term was 5.015. A breakdown 
of services to students over the last two years shows 
that there is an increase in instruction in language 
arts and other content areas such as science, social 
studies, and humanities. 

Services by Subject Area 

1965 




5% 



II 



j Student characteristics of those served are illustrated 
in th<> following tables: 



Services by 
Gender 



H% OIRLS S4% BOYS 




Services by 
Ethnicity 



INDIAN 
1% BLACK 



Services by 
LAU 

Category 





ENGLISH ONLY 
14% ENGLISH DOMINANT 
-40% BILINGUAL 
- 21% Lt DOMINANT 
10% Li ONLY 



Services by 
Migrant Status 



50% SETTLED OUT 
37% INTERSTATE 
13% INTRASTATE 



PROGRAM CHARACTERISTICS 

Support services are provided through a network of 
district, community, and program staff in order to 
determine the best approach in each individual case. 
More services are provided in attendance and 
y jidance than any other support area. The following 

19 



graph shows a duplicated count of support services 
given to program participants by service area. 

Support Services 



Total - 14,313 




The priority of the instructional program is English 
instruction to students of limited English proficiency 
and all language deficient migrant students. The 
other major areas of instruction include reading, 
math, and language arts. Individual diagnosis and 
prescription results in objectives desi,med to insure 
student success. Due to ihe high rate of migrancy 
among this special population, the number of weeks 
students »vere served varied from 4 weeks for 14% of 
the students served to 32 weeks for 45% of the 
students served. 

In most cases the students received supplemental in- 
struction in a migrant resource room. These pro- 
grams are termed pull-out programs because they oc- 
cur outside of the regular classroom. In all settings 
the instruction is by staff trained to address the 
specific needs of migrant students. 

Often when a child enters school speaking no 
English, a program of language instruction is set up 
on a one-to-one basis for as long as is necessary to 
make the student functional in English. Student-to- 
teacher ratios in all programs vary from 1:1 to 5:1. 
This ratio facilitates the learning of the child and 
enables him to master baric academic skills ap- 
propriate to his age, grade level, and individual 
abilities. 

The length of the instructional period varies by grade 
level and subject area. In English as a second 
language, 56% of the students received an average of 
2.5 hours of instruction per week while another 14% 
were instructed for 5 hours per week. In reading and 
language arts, 52% of the students received 2.5 hours 
per week of instruction and in math 34% received 
this type of intervention. 



PROGRAM EFFECTIVENESS 



PROGRAM STAFF 



Most '>f the achievement scores reported for par- 
ticipants in each program component reflect signifi- 
cant gains. The x-esuUs for English as a second 
language are an averaging of raw scores obtained on 
a language proficiency test. The results in reading, 
math, and language arts are expresseu in normal 
cur/e equivalents (NCEs). 

Gains in nationally tested basic skills areas are 
measured by a comparison to students who do not 
receive instruction from special programs. However, 
this group, due to the nature of testing, does not 
generally include the migrant population. Therefore, 
this type of evaluation of program effectiveness must 
be analyzed with these caveats in mind. 

The expected outcome for students who do not 
receiv( supplemental instruction is a zero NCE gain. 
This reflects the maintenance of the same relative 
standing throughout the year. Any change in the 
NCE ranking of a group of migrant students from 
pretest to posttest is attributed to Chapter I Migrant 
instruction. Thus, if a migrant student scored at the 
32nd NCE on the pretest and at the 38th NCE on the 
posttest, the gain of 6 NCE's is one measure of the im- 
pact of migrant instruction. 

In the following graph, data is included only for the 
levels with enough students (represented by cases) to 
be statistically significant. Note that the mean gains 
by subject area range from 1,70 in math to 4.64 in 
language arts. These overall results reflect significant 
gains in each program area . 



Average NCE Gain by Subject 
Area 









Number 


SubjMt 


T«at Cycle 


Mean NCE Gain 


of Caaea 


ESf 




15.18 


212 




Fall-Spring 


16 78 


183 




Spnng-Spring 


508 


29 


Reading 




2.79 


520 




Fali-Spring 


7 53 


235 




Spring-Spring 


-1 12 


285 


Math 




1 70 


295 




Fall-Spring 


9.40 


116 




spring-Spring 


-3.29 


179 


Language Arta 




464 


1.V 




Fall-Spring 


iOd 


37 




Spring-Spring 


5.95 


100 



*ESL: Scores are raw rather than NCE s 



Program staff employed by local school districts to 
provide instructional and sup^^ort services are 
classified in seven areas. The following graph shows 
the staff trend over the last two years. As illustrated, 
the number of certified I - "hers employed in the pro- 
gram has increased and the number of aides has 
decreased. 



Staff Trend 




Adminlllrtinn TttChtTi Taachct Horn* Set il MSRTS H«*lth CI*rtc*T 

Ai<ta* Coordlnalori Clarki f(0«M«(t 



Supportive assistance is given to each migrant project 
through a Migrant Education Resource Center. 
Technical assistance, inservice workshops, instruc- 
tional iterials, and production items are all provid- 
ed through the staff of the tvo centers. 



Resource Center Services 



Technical Assistance by Area 


Number of Contacts 


Curhculumn'esting 


636 


MSRTS 


1,135 


Production 


163 


Computer Support 


181 


Other 


109 


Inservice Woricshops 


Number of Participants 


Home-School 




Coordlnators/MSRTS CLERKS 


245 


Resource Teachers/Aideb 


365 


Parents 


135 


Summer School Personnel 


91 


instructional Materials 


Numk>er 


Curriculum Library Requests 


3,875 


Traveling Library Circulation 


3,135 


Production Items 


Number 


Requests 


394 


Copies or Pieces Produced 


435,992 
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MIGRANT SUMMER PROGRAM 

Summer school programs are operated in twenty- 
four (24) districts. The emphasis for all summer pro- 
grams is reading and mathematics. All students 
receive instruction in each of these three disciplii ?s 
for approximately one hour per day. Programs are 
planned to allow students more direct contact with 
the teacher through success-oriented individualized 
or small group instruction. 

Evening programs are designed for migrant secon- 
dary students who are unable to attend day programs 
due to employment. These programs are oi>erated in 
Nampa, Cassia, and Glenns Ferry school districts 
and serve students from a total of twelve districts. All 
three programs grant official school credit in courses 
designed to meet graduation requirements such as; 
English, Mathematics, Algebra, History, Govern- 
ment, and Biology. 

Summer Term Staff 



Administrators 24 

Elementary Teachers 144 

Secondary Teachers 35 

Teacher Aides 118 
Home-School Coordinators 24 

MSRTS Clerics 18 

Health Providers 9 

Clerical Personnel 13 



The projects r<erved 2,552 students who were from 
pre-school age through the 12th grade. As in the 
regular term, the group with the most participants 
was 1st grade. 

Summer School Participants 



m 




m K 1 2 S 4 S • 7 • • 10 11 12 UQ 



The total duplicated count of services to summer 
school students was 12,552. 'lliis count includes both 
instructional and support services and a breakdown 
by service area shows the emphasis in the academic 
areas, sp>ecifically in reading and math. 



Services by Subject Area 
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Evaluation Report 

Chapter I Neglected or Delinquent 

Project Year 1985-86^^= 

Chapter I funds are appropriated for grants to state 
agencies serving institutionalized neglected or delin- 
quent children. Th' state allocation of federal funds 
for the project year 1985-86 was $56,135.00. 

STUDENTS SERVED 

There are two institutions in Idaho which operate 
school programs and supplement instruction for 
neglected or delinquent youth with Chapter I funds. 
The Youth Services Center in St. Anthony operates 
its own program through direct support. The Idaho 
Youth Ranch located in the Minidoka School District 
is funded through the district Chapter I project. 

Participants by Grade Level 

Youth S«nrlCM C*nt*r Idaho Youth Ranch 

5 10 15 20 25 1 2 3 * 5 87 



^ I ?.l 

• r,',""; M I i 3 j 

10 1 ' ' io (""' """ """ fll 

11 ('*'''' j"''*' "i?T 2| 

12 Q] 12 I Tl 

Total M Total 24 



A number of neglected or delinquent students are 
also served in school district Chapter I p ograms. 
The total unduplicated count of these students in 
public schools was 107. 

Participants by Grade Levels 



26 




K1 2345676 9 10 11 12 



PROGRAM CHARACTERISTICS 

Chapter I instruction is designed to meet the specific 
needs of those children identified within each nstitu- 
tion. Instructional programs are provided in the 
areas of reading, mathematics, and language arts. 
The majority of the services are provided in pull-out 
programs where instruction takes place outside of the 
regular classroom. 

Services by Subject Area 

Youth Sorvicaa Cantar Idaho Youth Ranch School District Programs 

Language Arts 76% Reading 50% Readmg 53% 

Math 22% Math 50% Math 45% 

Language Arts 2% 

PROGRAM Eh'FECTIVENESS 

Evaluation data is collected on programs offered 
within the two state institutions. Because the students 
enrolled are often in the facility for only a short time 
the percent with both pre- and posttest scores is 
relatively low. The students who are served in 
district Chapter I programs are included in the state 
Chapter I evaluation and are not reported separately. 

The number of students by grade level is too low to 
allow a breakdown of this type on achievement 
results. Therefore, for students served in the two in- 
stitutions, summary data is included here by subject 
area. 

Average NCE Gain by 
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Evaluation Report 

Chapter I Handicapped P.L. 89-313 

Project Year 1985-86 ^^^^^ 



The purpose of this program, established under 
Public Law 89-313, is to provide financial assistance 
to state agencies for programs to meet the special 
educational needs of handicapped children. The state 
allocation of federal funds for the project year 
1985-86 was $169,175.00. Children served may be in 
state-supported schools or may have entered a local 
school district program. 

STUDENTS SERVED 

Three state-operated institutions were funded under 
this program to provide support and instructional 
services to children with several types of handicap- 
ping conditions: State Hospital South, Blackfoot; 
State School and Hospital, Nampa; State School for 
the Deaf and Blind, Gcoding. The total unduplicated 
count of students was 343. 

Participants in Institutions 




DEAF VISUALLY EMOTIONALLY MULTI-HANDICAPPED 

HANDICAPPED DISTURBED 

Seven local educational agencies operated programs 
for handicapped children. Instructional and support 
services were provided to children with several types 
of handicapping conditions as shown in the following 
graph. The total unduplicated count of students was 
35. 

Participants in School Districts 

Mentally Retarcied 24 

Emotionally Impaired 2 

Multi-handicapped 8 

Blind 1 
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PROGRAM CHARACTERISTICS 

In both institutional and school district programs, ob- 
jectives and methods are established for each student. 
At the completion of the project an evaluation is 
made of the degree to which each objective was met. 
It is not possible to provide summary data on these 
individual objectives and the evaluation of each due 
to the diversity of program goals. 
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Federal law prohibits discrimination on the basis of race, color, religion, sex, national origin, age, or handicap, in any educational pro- 
grams or activities receiving federal financial assistance. (Title VI and VII of the Civil Rights Act of 1964; Title IX of the Educational Amend- 
ments of 1972; and Section 504 of the Rehabilitation Act of 1973). 

It is the policy of the Idaho State Department of Education not to discnminate in any educational programs or activities or in employment 
practices. 

Inquiries regarding compliance with this nondiscnminatory policy mav be directed to Jerry I . Evans, State Supenntendent of Public In- 
struction, Len B. Jordan Office Building, Boise, Idaho 83720, (208) 334-3301, or to the Director of Office for Civil Rights, Department of 
Education, Washington, D.C. 



